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CHAPTER  1 
INTRODUCTION 

In  a  packet-switched  computer-communication  network  the  "messages" 
to  be  sent  are  broken  into  blocks  called  packets.  For  our  purposes  we  will 
consider  such  a  packet  as  the  basic  unit  of  input  to  and  flow  in  the  network. 
Our  objective  is  to  find  a  flow  which  minimizes  the  "delay"  in  a  particular 
network  for  a  particular  set  of  inputs. 

The  basic  algorithm  (developed  by  D.  P.  Bertsekas  [1]  and 
R.  Gallager  [2])  is  presented  using  a  general  measure  of  the  delay  (i.e.  a 
general  objective  function)  in  Chapter  2  along  with  a  description  of  certain 
procedures  developed  in  order  to  program  the  algorithm  efficiently.  Also,  in 
Section  2  of  Chapter  2,  possible  line  searches  are  discussed. 

In  Chapter  3  results  are  given  and  discussed  for  a  delay  function 
which  is  an  average  over  all  the  links  in  the  network.  The  delay  on  each 
link  is  computed  via  a  formula  suggested  by  Kleinrock  [15]. 

In  Chapter  4,  the  algorithm  is  adapted  to  solve  the  "dual" 
problem  in  an  approximation  scheme  based  on  a  method  of  multipliers  with 
exponential  penalty  function  due  to  Kort  and  Bertsekas  [13].  In  this  case 
we  attempt  to  minimize  the  largest  link  utilization  in  the  network  where  the 
utilization  of  a  particular  link  is  the  ratio  of  the  flow  to  the  capacity  of 


that  link. 
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CHAPTER  2 

THE  ALGORITHM  AND  THE  PROGRAM 

2.1.  Mathematical  Description  of  the  Basic  Algorithm 

We  consider  a  network  consisting  of  N  nodes  represented  by 

7c=  {1,2, . . . ,N}  and  a  set  £  of  L  directed  links.  We  denote  a  link  from 

node  i  to  node  j  by  the  ordered  pair  (i,j).  It  is  assumed  that  given 

nodes  i  and  j  there  exist  nodes  k^,...,km  such  that  (i,k^) , (k^jkj) , . . • , 

(k  ,,k  ),(k  ,j)  are  elements  of  £ . 
m-1  m  m 

Let  represent  the  portion  of  the  flow  in  link  (i,k) 

which  is  destined  for  node  j.  Consider  the  following  multicommodity  flow 
problem  in  the  variables  f^Cj) 

r-  N 

minimize  £  D,,  [ . E  f ..  (j )]  (MFP) 

(i,k)€=C  ltc  J=1 

subject  to  T  f  5(j)~  I  f  .  (j)  =  ie7i»  je7Z 

kE&d)  rf=i(i)  ml  1 

flk(3)  >  0  v{i,k)e£,  je7c 

fjk(j)  “  0  v<J»k>6X 

where  O(i)  =  {ke7(|  (i,k)€£},  I(i)  -  {me7(  |  (m,i)S£},  and  ri(j)  represents 
the  known  traffic  input  at  node  i  which  is  destined  for  node  j.  We 
assume  r^jJX)  Vie 71,  j€?i  and  that  v(i,i)S£  Du  is  a  twice  con¬ 
tinuously  differentiable  real-valued  function  on  [0,°°)  whose  first  and 
second  derivatives  are  positive. 


i 
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2.1.1.  The  Goldstein-Levitin-Polyak  Gradient  Projection  Method 


The  Goldstein-Levitin-Polyak  gradient  projection  method  may  be 
used  to  solve  the  constrained  optimization  problem: 


minimize  f(x) 

(1) 

subject  to  Ax=b,  x^G 

where  f  :  Rn-*-R  is  a  twice  continuously  differentiable  function,  A  is  an 
np<n  matrix,  and  b  an  m-dimensional  column  vector. 

Beginning  with  an  initial  feasible  vector  xQ6Rn  we  generate 
x^+^  from  by  letting 


x^+^  =  x k  where  x^  solves : 


T  T 

linimize  Vf(x)  (x-x^)  +  l/2(x-x^)  M^(x-x^) 


subject  to  Ax=b,  x>0, 

where  is  a  symmetric  matrix  which  is  positive  definite  on  the  null 
T 

space  of  A,  i.e.  x  M^x>0,  Vx  ^  0  such  that  Ax=0.  The  objective  function 

in  the  problem  (3)  is  to  be  thought  of  as  a  quadratic  approximation  of  f 

2 

on  the  constraint  set.  In  particular  if  we  let  =  V  f(x^)  (assuming 

positive  definiteness  on  the  null  space  of  A)  the  problem  (2)>(3)  becomes  a 

constrained  version  of  Newton's  method.  In  this  case  when  problem  (1) 

has  a  unique  solution  3c,  this  method  converges  to  x  at  a  superlinear  rate 

if  xq  is  close  enough  to  3c  (see  {3],  Theorem  7.1).  However,  in  most 

2 

situations  (3)  is  too  difficult  to  solve  with  =  V  f(x^)  and  must  be 

2  2 

merely  an  approximation  to  V  f(x^)  (e.g.  equal  to  7  f(x^)  on  the 
diagonal  and  zero  of f ) . 


I 
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More  information  on  this  method  nay  be  found  in  [1],  [3],  and 
[4].  In  particular,  in  [1]  it  is  shown  that  under  mild  assumptions, 
choosing  M.  sufficiently  large,  this  method  converges. 


2.1.2.  The  Basic  Algorithm 

For  simplicity  of  notation  and  explanation  we  consider  the 
special  case  where  there  is  only  one  destination,  i.e.  r.(j)  =  0  Vi,j£  ?i 
with  j^N.  We  may  now  write  the  original  problem  in  the  following  form 


minimize  }  D.„(f.„) 

U.Oec  14  u 

i^N 


(SFP) 


subject  to  < 


l  fi  -  l  fmi  =  r,  i  =  l,...,N-l 
2£&i  nei(i)  1 
m^N 

fi4  >  0  V(i,l)6£  with  i^M. 


If  we  define  the  total  traffic  at  node  i  to  be 


t.  *  r.  +  l  f  .  for  i=l,...,N-l 
1  1  nei(i)  1111 

m#N 

we  may  then  (for  all  i  with  t^O)  define  the  fraction  of  traffic  at  node  i 
which  will  travel  via  link  (i,l)  to  be 

f , 


i  l 


i  l 


when  (!,£)€£. 


(SFP)  may  be  reformulated  in  terms  of  these  variables  as  in  [2]. 

For  each  node  i?*N  fix  an  ordering  of  the  links  (i,£.)€£  having 

J4 ^ 0( i )  and  let  <p  be  the  column  vector  with  entries  (i,£)  so 

ordered.  Identify  with  each  set  {< fi  (1 ,1)  €  £  i=l,...,N-l}  the  column 

T  T 

vector  ^  ...  .  Let 
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$  =  i'P  ■'f  .  ,  >  0  for  all  (i,  Z)e£  ,  "  v  .  ,  *  1  for  i  =  l ....  ,N-1  ■ 

lZ  **>(i)  lc 

and  let 

$  =  {^e$j3  (i,£)  , .  . .  ,  (m,N)  G£  forcing  a  connected  directed 
path  from  i  to  N  for  all  1=1,..., N-l  with 

*it>0 . ',mN>0)- 

One  may  easily  verify  that  <t>  and  4>  are  convex  and  that  the  closure  of  i 
is  T. 


Gallager  has  shown  (see  [2],  Theorem  1)  that  for  each  y'6  J  and 
T 

r  =  (r  , . . .  ,rN  with  r^>0  for  all  i=l,...,N-l,  there  exist  unique  vectors 

T 

t(>p  ,  r)  =  (t  (-P  ,r)  , .  . .  ,t  .(^,r))  and  f(*,r)  with  coordinates  f.,(^,r) 
i  n-i  it 

i^N,  ordered  as  was  ,  which  satisfy 


t(^,r)  >  0  f(^,r)  >  0 

t,  (<P,r)  *  r  +  l  i  ,r)  for  i=l,...,S-l 
1  raei(i)  131 
m^N 

l  f..(v,r)  -  l  f  (v>  ,r)  =  r  for  i=l . N-l 

ae>(i)  lS-  nei(i)  mi  1 

m#N 

f  iJl  ^  ’  r>  =  ti^>r^i  i  i  =  1 . N> 

Furthermore  the  functions  t(y?,r)  and  f(v?,r)  are  twice  continuously 

differentiable  in  the  relative  interior  of  $  *  {r|r>0},  their  common  domain, 

and  these  derivatives  can  be  extended  to  the  relative  boundary  by  taking 

the  limit  through  the  relative  interior.  Also  for  each  0  we  have: 

given  an  f  feasible  for  (SFP)  there  exists  with  f(^,r)  =  f. 

It  now  follows  that  we  may  rewrite  (SFP)  in  terms  of  the 

variables  'f  . ,  as 
ll 
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minimize  D(*,r) 
subject  to 


(A) 


where  D(^,r)  =  I  D. , [f . . (* ,r) ] . 

(i.i)^"  “ 

i^N  _ 

If  we  ignore  the  difference  between  $  and  i  we  see  that  (4)  has 

the  same  form  as  the  problem  (1)  considered  earlier.  Therefore  we  consider 

the  iteration 


k+1  -k 
*i  =  *i 


i=  1,...  ,N-1 


(5) 


where  solves 


minimize 


,3D(*  ,r)  ,T,  k.  .  1  ,  ksTwk„  k, 
( — — 1 )  (.‘fi  .  -s’  .  )  +  :r  ('fi  .  -V  .  )  M .  .  —P  ) 

&P  .  XX  Z  X  X  X  X 

1 


(6) 


subject  to  I  tfi  =  1 

1  ieO(i) 

k  k 

where  is  Che  vector  o£  the  partial  derivatives  5D^,  (i), 

1  k  il 

evaluated  at  (v  ,r).  This  is  the  gradient  projection  method  (2)  with  in 

(3)  block  diagonal  form  with  ^  along  the  diagonal. 

For  a  given  we  define  a  node  k  to  be  downstream  from  a  node  i 

if  there  is  a  directed  path  from  i  to  k  such  that  for  every  link  (£,m)  in 

that  path  we  have  <fi „  >0.  In  this  case  we  also  refer  to  i  as  being  upstream 

from  k.  If  there  are  no  two  distinct  nodes  i  and  k  such  that  i  is  both 

upstream  and  downstream  from  k  we  say  that  y  is  loop-free.  Notice  that  v> 

is  loop-free  if  and  only  if  the  downstream  (or  equivalently  upstream) 

relation  defines  a  partial  ordering  (see  [5])  of  7[  the  set  of  nodes. 

k+1  k  k+1 

It  is  necessary  to  have  f  €$  whenever  <p  S<J>,  where  <p  is  given 

k  k+1 

by  (5).  We  can  ensure  this  by  insisting  that  both  <P  and  are  loop-free. 

We  will  see  later  that  loop-freedom  will  also  facilitate  efficient  computa- 

3D 


tion  of  the  derivatives 


3* 


needed  in  (6) . 


kft 


For  any  and  r>0  the  partial  derivatives  — —  ■  nay 


computed  from 


=  ti[Du(fu)  +  I7]  i  =  1 . N-1. 


where  f .  ^  is  the  flow  on  (i,!.)  which  is  uniquely  defined  for  each  (i,l)€£ 

by  'f  and  r,  D*  (f..)  denotes  the  first  derivative  of  D..  with  respect  to  f.. 

ix,  it  i  v  1 1 

.  3D  . 

and  — —  is  given  by 

dr. 


-  &  ‘-1 . ^ 

l  m  m 


These  equations  uniquely  determine  and  For  a  more  detailed 

3*U  3ri 

discussion  of  the  above  ideas  and  derivations  of  equations  (7),  (8),  and  (9) 
see  [2]  and  [1], 

The  algorithm  (5),  (6)  must  be  modified  so  that  loop-freedom  is 
maintained.  Certain  of  the  variables  <p ,  which  must  be  kept  at  zero  in 
order  to  maintain  loop-freedom,  are  specified  in  the  following  definition 


Definition:  For  a  and  i=l,...,N-l  the  set  of  blocked  nodes  for  <£_  at  i, 
B(i,i) , is  the  set  of  all  £G£(i)  with  ^  ,  =  0  such  that  — 2-r-~  <  or 


there  exists  a  link  (m,n)  with  n  downstream  from  Jt  and 
9D^  tr)  ^  ?r)  /_  ij-j.  such  as  (m.n)  is  referred  to 


Y  *■  M  —  (a  link  such  as  (m,n)  is  referred  to  as  imp 

m  n 

We  may  now  state  a  modified  version  of  (5),  (6): 


k+1 

<P^  * 


where  <fi ^  is  any  solution  of  the  problem 


minimize  ^(^.r)1^-^)  +  ■|('Pi-V^)TM^(^i^^) 


subject  to  >  0,  l  v».0“l,  ¥> , 


Vi€B(i,^k) 


(ID 


i 


and  where  the  vector  5  (<p  ,  r)  has  components 


+as^' 

k  k 

For  each  i  with  t^(v?  ,r)  >0,  the  matrix  is  some  symmetric  matrix  which 
is  positive  definite  on  the  subspace 

{vi !  .  I  k  vu  =  0}> 

k  k 

but  =  0  for  those  with  t .  Op  ,r)>0. 

Some  important  properties  of  the  algorithm  (10),  (11)  are  given  in 

the  following  proposition  (this  is  Proposition  1  in  [1]  and  its  proof  may 

be  found  there) . 

k  k+1 

Proposition:  a)  If  is  loop-free  then  ^  is  loop-free. 

k  k 

b)  If  v  is  loop-free  and  solves  problem  (11)  then  *4  is  optimal  [for  (4)]. 

k  k+1 

c)  If  4  is  optimal  then  4  is  also  optimal. 

~ “k  k  k 

d)  If  for  some  i  for  which  t^O?  , r)  >  0  then  there  exists  a  positive 

scalar  such  that 

D[^k+  nC^-v’k)  ,r]  <  D(v?k,r)  Vr\6(0,\]. 

It  should  be  noted  that  (11)  was  derived  from  (6)  by  dividing  the 

k  k  -1 

objective  function  in  (6)  by  ,r)  and  assimilating  the  factor  [t^(v>  ,r)] 

into  M^. 

l 

k 

2.1.3.  Selection  and  Calculation  of  M-; 

k  k 

As  mentioned  earlier  letting  be  the  Hessian  of  D(v»  ,r)  with 

respect  to  <fi  gives  excellent  convergence.  We  attempt  to  approximate  this 

2  k 

success  by  letting  be  a  diagonal  matrix  with  [t Op^r)]  ^  [ -  -D f  r-^]  (i,I)€£ 
along  the  diagonal.  These  second  derivatives  are  very  hard  to  compute  but 


I 


i 
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reasonably  accurate  upper  and  lower  bounds  for  them  have  been  calculated  (1). 
For  all  l 

(3V 


where  and  are  generated  by 


(D"  +R  )  ' 

—l  m  l  £m  — m 

FL  *  Z  V2.  0"  +  [l  <fie  ^]2 
l  a  ta  to  m  £m 


h  ■  °- 


,2- 
o  D 


These  are  used  to  calculate  corresponding  bounds  on  • — t—  via 

,  *11 

hi  -  \ (Du  +  h~> 

—  2  _ 

$  *  t  (D"  +  R  )  . 

i l  Vi «.  V 


(12) 


2.1.4.  The  Algorithm 

We  arrive  at  the  following  algorithm.  If  ^  =  0,  we  take  in  (11) 

k  — 

to  be  zero,  and  if  t^  4  0  we  take  to  be  the  diagonal  matrix  with  £€0(i), 

along  the  diagonal.  With  this  choice  of  (for  t^O)  the  subproblem  (11) 
may  be  rewritten  as 


minimize 

subject  Co  v9 ^ ^  >  0,  £  y *  1,  y?^  *  0  VZ.6B(i,y>k) 


(13) 


and  solved  using  a  Lagrange  multiplier  technique.  By  substituting  for  $ 
the  expression  in  (12)  and  turning  the  crank  we  obtain 


U 


^2  ‘  "“W.  ^2  " 


6.  -  X 
ii 


ei<D«  +  R»> 


(14) 


where  X  is  a  Lagrange  multiplier  determined  from 

r  k 

2,  max{0, 


5u-x 


^B(i,y>k) 


} 


(15) 
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and 


11 


iJl 

We  have  that 


f-(n)  =  fU  +  n(fi2"fU}’  Vn>°  (i’i)££- 


dDT[f  (n) 


dn 


=  y  d'  (fk  ) (fk  -fk  > 

L  i  V  K  i  l  i  V 

n=0  (i,Z)€£  lJt  lSC  liC 


I  ^(^06  (Ar)(?*  V[,). 

1c  Ic  — Ic 

Therefore  if  there  exists  an  i  with  and  t^(<?  ,r)  #  0  we  have  from 

the  necessary  condition  for  optimality  in  (11)  that 


dD?[f  (n) ] 


dn 


<  0. 


n=0 


— 1/  If 

Thus  (f  -f  )  is  a  direction  of  descent  for  D^,(f)  at  f  and  (18)-(19)  is  a 

reasonable  choice.  Also  f>T[f  (n) ]  is  a  convex  function  in  n,  this  makes  the 

k 

minimization  in  (19)  relatively  easy  to  perform,  and  evaluating  [ f  ( n) ] 

k  k  k 

at  specific  points  is  much  simpler  than  evaluating  D [y?  +  n(<0  -P  ),r]. 

A  problem  that  can  arise  with  the  algorithm  (18)- (.19)  is  that  if 

for  some  (i,£)S£  (i,£)  is  improper  at  the  kth  iteration  (note  that  this 

k  — k  k+1 

implies  f..  >0)  and  n  <  1  then  even  if  f  *0  we  will  still  have  P  >0. 

lJv  K  X  X»  1 

Thus  it  is  likely  that  (i,£)  will  remain  improper.  Of  course,  this  will 
only  be  a  significant  problem  if  <  1  for  several  consecutive  iterations 
thereby  impeding  convergence. 

The  following  algorithm  has  been  proposed  [1]  to  resolve  this 

k  — —k 

difficulty.  Given  a  loopfree  p  and  ne  (0,1]  we  denote  by  ^(n)  a  solution 
of  the  following  altered  version  of  (11) 


minimize  5i(^k,r)T(«^i-v>k)  +  i-(v>i-v»k)TMk(v>i-v’^) 
subject  to  p  >  0,  Ip  *  1,  p  »  0  V£G  B(i  ;^k) 

X  £  lx.  1J6 


(20) 
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with  positive  definite  on  the  subspace  {v  | 
ti(v’^,r)>0  and  Mk  =  0  otherwise.  Fix  8£(0,1) 


is 


k+1  — 

<fi  *  t  (S  ) 


I  u  v<  o  =  0 
i^B(i,^k)  l£ 
and  o€ (0 , 0 . 5) . 


if 

The  algorithm 


(21) 


where  m^  is  the  first  nonnegative  integer  m  satisfying 

k  T 

k  .  k..m.  ,  ^  3D(<£  ,  r)  r  k  — k.^ra.  , 

D(¥>  ,r)  -  D{*  (6  )  ,r]  >  a  — »■  y  [<p  ->fi  (8  )  ] 


(22) 


—k  m 

unless  it  is  found  that  ^^(0  )  >  0  for  all  (i,£)  which  are  improper  for 

k  k 

<P  ,  then  we  switch  to  a  search  along  the  ray  from  f (^  ,r)  through 

f(?k(6m) ,r). 


Although  we  do  not  prove  convergence  here,  algorithms  similar  to 
this  one  have  been  shown  to  converge  under  mild  assumptions  ([l],[l4])  and 
those  proofs  can  be  modified  to  work  here. 

The  algorithm  (20)-(22)  is  far  more  burdensome  computationally 
than  the  algorithm  ( 18 ) — (19 ) .  Therefore  we  consider  this  combined  algorithm: 

Jq  _ 

if  ^  has  an  improper  link  (i,2)  with  *  0  then  we  use  (20)-(22),  if  not 
then  we  use  (18)-(19) .  Also  (20)-(22)  is  modified  so  that  for  each  m < 

[i.e.  mwith'?k(Bm)  failing  the  test  (22)]  ^k(Bm)  is  examined. 


2.3.  Description  of  the  Program 

The  basic  algorithm  described  in  the  preceding  parts  of  this 
chapter  and  outlined  in  the  flow  chart  in  Figure  1  was  programmed  in  SAIL 
(see  [9], [10]),  an  ALGOL-like  language  for  the  PDP10.  Actually  the  program 
was  developed  in  several  stages.  First  the  algorithm  of  Section  2.1  was 
programmed, then  just  the  flows  linesearch  was  incorporated, and  finally  the 
combined  linesearch  algorithm  of  the  preceding  section  was  added. 


Figure  1.  The  basic  algorithm 
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All  three  were  programmed  in  two  different  versions.  One, 

k+1 

called  the  all-at-once  version,  consists  of  one  iteration  in  which  •f 

Ic 

is  calculated  for  all  commodities  using  just  the  information  from  y  . 

The  other,  called  the  one-at-a-time  version,  consists  of  one  iteration  for 

k+1 

each  commodity  receiving  flow  with  the  derivatives  used  to  calculate  •f 
for  a  particular  commodity  being  recomputed  immediately  before  the 
iteration  for  that  commodity.  For  a  comparison  see  Chapter  3,  particularly 
the  eleven  node  network  example. 

The  more  algorithmically  complex  aspects  of  the  basic  program 
are  detailed  in  the  subsequent  sections  of  this  chapter.  Those  portions 
not  covered  were  programmed  in  a  straightforward  manner. 


2.3.1.  Initial  Routing 

For  the  algorithm  described  above  we  must  have  an  initial 
feasible  set  of  routing  variables  <fi° .  We  used  the  "shortest-path"  routing 
i.e.  for  each  node  i  the  flow  destined  for  node  j  is  routed  along  the  path 
from  node  i  to  node  j  that  contains  the  fewest  links.  If  multiple  shortest 
paths  exist  then  the  flow  is  divided  among  them  equally.  We  note  that  if 
node  k  lies  on  a  shortest  path  from  node  i  to  node  j  then  the  portion  of 
this  path  which  runs  from  k  to  j  is  a  shortest  path  from  k  to  j ,  therefore 
this  determines  a  set  of  routing  variables  In  fact,  (i.e.,  f0 

is  feasible)  since  by  its  definition  we  have  from  each  node  to  the 
destination  a  path  with  <fi°  nonzero  along  that  path. 

There  are  many  available  methods  for  finding  the  shortest  paths 


between  all  pairs  of  nodes  in  a  network  (see  Dreyfus  [6],  section  2). 
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None  of  these  is  more  computationally  efficient  than  one  by  Flovd  [7] 
which  was  based  on  a  procedure  by  Warshall  [8]  and  is  the  one  we  have 
used  here. 

2.3.2.  Calculating  the  Traffic  and  Flow 

Given  a  set  of  inputs  r  and  a  loop-free  set  of  routing  variables 
<£€<!>, we  wish  to  determine  the  corresponding  traffic  tOf,r)  and  flow  f(<p,r). 
From  the  definitions  of  Section  2.1  we  have  the  following 
formuli 

t.(j)  -  r  (j)  +  E  f.(j)  Vi€^,  j ST}  (23) 

tJj1’ 

-  tm(j)»ml(j)  v(»,i)ec,  vjetu  (24) 

In  Section  2.1  we  saw  that  for  a  fixed  commodity  j  the  downstream 
relation  due  to  a  loop-free  s o  determines  a  partial  ordering  on  %  .  For  any 
maximal  node  i  (i.e.  no  other  node  is  upstream  from  i) ,  (23)  and  (24) 
become 

t±(J)  =  ri(j)  (25) 

f  .(j)  -  0  Vm6I(i).  (26) 

mi 

Having  calculated  the  traffic  and  flow  at  all  the  maximal  nodes 
using  (25)  and  (26) ,  we  would  like  to  proceed  to  nodes  which  are  immediately 
downstream  from  some  maximal  node  and  calculate  their  traffic  and  flow 
using  (23)  and  (24).  These  nodes  are  easily  found  since  $(i)  is  compiled 
and  stored  for  each  iSTl  in  the  initial  portion  of  the  program,  and  we 
have  that  k  is  such  a  node  if  and  only  if  kSeti)  and  51  0.  The  one 

problem  with  this  procedure  is  that  a  node  which  is  immediately  downstream 
from  one  maximal  node  may  be  two  or  more  nodes  downstream  from  another 
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maximal  node.  Therefore  to  calculate  the  traffic  and  flow  at  a  non- 
maximal  node  using  (23)  and  (24)  we  must  wait  until  the  traffic  and  flow 
have  been  calculated  at  all  upstream  neighbors.  This  we  accomplish 
by  use  of  two  n-dimensional  logical  vectors,  i.e.  vectors  with  entries  true 
or  false.  One  vector  indicates  those  nodes  for  which  the  traffic  and  flow 
have  already  been  calculated.  The  other  indicates  those  nodes  not  indicated 
in  the  first  vector  which  are  immediately  downstream  from  at  least  one  node 
which  is  indicated  in  the  first  vector.  When  a  node  in  the  second  vector 
has  all  its  upstream  neighbors  in  the  first  vector,  its  traffic  and  flow  are 
calculated  using  (23)  and  (24)  and  it  is  removed  from  the  second  vector 
and  indicated  in  the  first.  Finally,  all  its  downstream  neighbors  are 
indicated  in  the  second.  This  procedure  is  iterated  and  we  terminate  when 
the  destination  node  j  is  indicated  in  the  first  vector  since  it  is  the 
unique  minimal  node,  i.e.  it  is  downstream  from  all  others. 


2.3.3.  Calculating  ’  ,  and  B(i,y?),  and 

dr  -  i. 

_ 3r _ 

Determining  Improper  Links 

We  assume  now  that  r  and  y?  are  given  and  t(y>,r)  and  f(y>,r) 
have  been  calculated  as  in  the  preceding  section.  We  recall  the  following 
formuli  from  Section  2.1 


3D(l ,r) 

a^U) 


£  *ik(J)IDikC£ik) 

keeti) 


(27) 


3D(?.r)  „  n 
(j) 
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~  32D(v>  ,  r)~ 

.  . 

'  3 2P ,  r)~ 
-  3rj(j). 


k£(f(i) 


^ik^'W  + 


LkSO(i)  lk 


3  D(*,r) 
3r,2(j) 


(28) 


0. 


We  note  for  fixed  i  and  j  that, just  as  (23)  and  (24)  only  use  information 
from  upstream  neighbors  of  i,  the  formuli  (27)  and  (28)  only  use  informa¬ 
tion  from  downstream  neighbors  of  i.  Therefore  we  utilize  the  same  two- 
vector  passing  scheme  except  we  pass  upstream  not  downstream.  Here  the 
stopping  condition  is  more  complicated,  in  that  we  must  check  all  maximal 
nodes  rather  than  just  the  one  minimal  node  as  in  the  previous  section. 

In  order  to  determine  for  a  given  destination  j  and  node  i/j 
the  set  B(i;^)  we  must  consider  all  nodes  k€^(i)  with  ^^(j)  =  0  and 
determine  which  of  these  satisfy 


3D(l ,r)  ^  3D(l ,r) 

3r.(j)  3rk(j) 

or  are  upstream  from  an  improper  link.  Thus  along  with  each  pass  upstream 
of  information  we  pass  knowledge  of  an  improper  link  existing  downstream. 


3D(l , r)  . 


3D(v>  ,r) 


for 


After  this  pass  the  newly  computed  -  ^ y  is  compared  with 

i  k 

each  k  with  ^ilc(j)  >  0  to  determine  if  (i,k)  is  improper.  If  this  is  the 

case  for  any  such  k  then  i  is  noted  as  a  node  with  an  improper  link  down¬ 
stream  (also  (i,k)  is  noted  for  later  as  an  improper  link,  see  the  section 
on  linesearches) .  For  those  k  with  ^k(j)  >  0  we  have  that  i€B(k;^).  This 
is  intuitively  clear  since  otherwise  we  might  get  a  loop  from  i  to  k  to  i. 


More  rigorously,  <£^k(j)  >0  and  ^  loop-free  imply  ^i^  =  ®  and  we  see  that 
if  (i,k)  is  not  improper  then  > 


3^0) 


3rk(j) 


i*j 


and  the 
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first  part  of  the  definition  of  i£B(k;^)  is  satisfied,  otherwise  (i,k) 
is  the  downstream  improper  link  for  node  i  necessary  to  satisfy  the  second 
part  of  this  definition. 

We  would  like  to  determine  B(i;y>)  at  the  time  that  we  pass 

3  J)  ({0  ) 

information  to  node  i.  However  this  is  not  possible  since  - - ~rr  may  not 

3Ck(j) 

have  been  calculated  for  some  k€£Xi)  with  *  (j)=0.  Therefore  once 

— 1 r\-  has  been  calculated  for  all  i,  we  go  back  over  f>(i)  for  each  i 
checking  for  additional  k€3(i)  which  belong  in  B(i;<£). 


2.3.4.  Solution  of  (13)  Via  (14)  and  (15) 

Again  assuming  the  destination  j  is  fixed  we  may  rewrite  (15)  as 


max { 0 ,  ^y(A  “  uiZ(j))  >  =  1 

X  Z 


where  we  have  used  the  following  notation 

Uu<j)  * 

Since  d^Jl(j)>0,  (29)  is  actually 

.  z  T~1JT  (A_  Uu(j))  =  1’  < 

l  such  that 

uU(J)<X 

Let  M  be  the  number  of  nodes  in  the  set  0^(i)\  B(i;^>)  (the  set  of  nodes  l 

with  JlGe^i)  and  J^B(i;^)).  We  rearrange  this  set  so  that  u  (j)  < 

1 

u  (j)  <  •••  <  u.  (j).  If  we  let  m  be  the  smallest  positive  integer 
ll2  1  M 

such  that 


Ji  TTTaJ  <uit.<j> '  <3))  >x 

1  m  m  ra 


then  we  see  that  if  X*  solves  (30)  then  (A*,l)  lies  on  the  line  segment 
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between  (u.,  (j),W[u.,  (j)])  and  (u.,  (j),W[u.,  (j)]  where 

1  _  1a-_  14. 

m-  X  jtj—  X  m  m 


M 


rv  (J))}. 


W[A]  =  E  max{0 ,  —  \  v 

m=l  diA 

m 


Therefore 


uii_(j)[1-W(uu_  (j)]]+uu_  [W[u.e_(j)]-1] 

.  *  m _ m-1 _ m-I _ m _ 

"  (W[u  (j)]-W[uu  (j)]) 

m  m-1 


Of  course,  it  is  possible  that  we  might  have  W[u  ( j ) ] < 1 . 

1  M 


In  this  case 


u  ?  (j) 
M 

1+  E  - — ^Vrr 
i=l  d,.  O) 


k  *  = 


il 

m 

-n - 1 

i=i  di, 


m 


2.3.5.  Line  Searches 

We  wish  to  solve  the  problem  (19)  of  Section  2.2.  We  reiterate 
the  important  fact  that  the  objective  function, 

D^,k(n,|-<1.UD«If»  +  "<-f»,h 

is  convex  in  the  variable  n  (note  that  for  a  given  f  we  use  the  notation 
n 

f.  *  E  f  (j)).  This  simplifies  and  increases  the  effectiveness  of  the 
lx,  j s=X  lx, 

following  minimization  procedure  which  entails  fitting  a  cubic  polynomial 
to  the  objective  function  [11].  Also  it  guarantees  that  the  local  minimum 


that  this  procedure  reaches  is  a  global  one  (along  the  line  of  search) . 
— k  k 

Since  (f  -f  )  is  a  descent  direction  we  can  be  sure  that  the 

minimizing  p*  will  be  positive.  Thus  we  first  check  whether 
dDT[fk(n) ] 


dp 

dDT[fk(n)] 


=  0.  If  it  does  then  n*  =  l.  If  not  then  we  see  if 


P=1 


dp 


>0.  If  this  is  the  case  then  we  know  p*£(0,l). 


P=1 
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The  third  possibility  is  that 


dDT[f*(n)] 


<0.  This  implies  n  >  1. 


Of  course  since  the  constraint  set  to  the  original  problem  is  compact  and 


convex  there  exists  a  unique  n**l  such  that  n  >  n  if  and  only  if 

fu(J)  +  n(fu(j)-fu(J))<0  for  some  •  If>  for  some 

(i, £.)€£,  jS7t  ,  we  have  fk^(j)  >0  and  f^(j)  =  0  then  n=l  otherwise  n  is 


the  solution  of 


minimize 
over  all 

(i,l)&C,  j£/\  with 

fu(i)>Tii(j) 


dD  [f  (n)] 
Thus,  - — - 

„n=1 

otherwise  n’^O.ri)- 


<0  implies  n*£(l,n].  If 


dDT[f^(n) ] 


„  <  0  then  n*  =  n 
n=n 


If  we  have  not  found  n*  at  this  point  (i.e.  if  n* t  1  and  n* ^  n)  then 


we  have  determined  an  interval  (A,B)  (either  (0,1)  or  (l,n))  such  that 

.  k  k  dVf(h)] 

q*S(A,B) .  We  fit  a  cubic  polynomial  to  D  [f  (A)],  D  [f  (B)],  - ■; - 

<1D  [f(n)3 1  n  n- 

and  - - -  and  find  the  minimum  of  this  polynomial  which  occurs  at 


where 


C  =  B 


D^[fk(B)]+W- 
'  _D’ [f(B) ]  -  D ' [ f (A 


[  f (A) ]  +  2W 


(B-A) 


D^[fR(0] 


dD_[f  (n) ] 


'n*=(-) 


_DT[fk(A)]  -DT[fk(B)]' 


D^[fk(A)]  +  D^[fK(B)] 


W  =  [Z2-D’[fk(A)]D^[fk(B)]]V2  . 


Next  we  evaluate  D^[f(C)].  If  D^,[f(C)]“0  then  n*=C.  If  D,j,[f(C)]>0 
then  n*e(A,C)  so  we  let  B  =  C.  If  D^,[f(C)]<0  then  n*6(C,B)  so  we  let  A=  C. 
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In  either  of  the  last  two  cases  we  then  repeat  this  procedure  for  the  new 
(A, B) . 

Since  the  above  algorithm  nay  never  terminate, we  replaced  the 
condition  D^,[f(C)3  =  Q  by  |D^[f(C)]j  <  £  '  D^.[  f  (0)  ]  |  where  £  is  some  small 
positive  number  (we  found  e=.l  appropriate).  A  flow  chart  for  this 
algorithm  may  be  found  in  Figure  2. 

The  other  parts  of  the  line  search  algorithm  were  programmed  as 
presented  in  Section  2.2.  We  used  3=  .5  and  o=  .1  in  the  Armijo  rule 
(21)  —  (22) . 


CHAPTER  3 


COMPUTATIONAL  RESULTS  FOR  THE  KLEINROCK  DELAY  FUNCTION 


The  programs  referred  to  in  Section  2.3  were  imple¬ 
mented  using  a  delay  function  based  on  the  formula  for  queuing  delay  in 


an  M/M/1  queue  (see  Kleinrock  [15]) 


Vf)  =  cT^f 

m 


,  f 6  [0,C±Z> 


where  for  each  (i ,!)€£,  is  a  positive  number  called  the  capacity  of 
(i,£).  In  order  to  satisfy  the  defining  properties  from  Chapter  2  (in 
particular  that  be  twice  continuously  differentiable  on  [0,“))  we 

used  the  following  extended  version  of  Q^tf): 


«u(f) 

Du(f)  =  Q«(-99cii>  +  ^*(-99cn>lf-99c«1 


if  f  <  . 99C . 


v  |Q^(-"Vtf-"cu]2  ^  f>.99Cit. 

We  note  that  not  only  does  this  meet  all  the  requirements  of  Chapter  2  but 

if  f.  <.99C..,  for  all  (i ,£)€£,  at  the  optimum  then  minimizing  Z  D 

iK.  ik.  (i.oec 

is  equivalent  to  minimizing  Z  Q  . 

(i,£)QC  11 

The  various  versions  of  the  program  were  tested  on  several 
network  configurations  and  most  of  these  for  many  different  inputs.  We 


now  present  a  selection  of  these  results. 


8-node  network:  The  programs  were  run  for  the  network  in  Figure  3  with 
inputs  r  (j)  =  3  for  i  =  l,...,8,  and  j  =[ (i+1) (modulo  8)  ]+l  or 
j  =  [ (i+5) (modulo  8)]+l,  and  r^(j)  =  0  for  all  other  (i,j).  The  results 
are  listed  in  Table  1.  (Note  the  following  abbreviations:  l.s.  for  line 
search,  a-a-o  for  all-at-once,  and  o-a-a-t  for  one-at-a-time. ) 
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Table  1.  8-node  Network 


oration 

w/o  l.s. 

l.s.  a-a-o 

l.s.  o-a-a-i 

0 

85,216.7 

85,216.7 

85,216.7 

1 

200.840 

45.5844 

200.840 

2 

63.2707 

44.3713 

48.9063 

3 

46.5705 

43.6303 

46.0621 

44.8815 

43.1652 

45.0389 

5 

44.1566 

42.8464 

44.3377 

6 

43.7075 

42.5588 

43.7518 

7 

43.3439 

42.3653 

43.3220 

8 

43.0258 

42.2802 

43.0260 

9 

42.7485 

42.1404 

42.7940 

10 

42.5163 

42.1059 

42.6064 

11 

42.3418 

42.0708 

42.4301 

12 

42.2280 

42.0462 

42.2758 

13 

42.1878 

42.0268 

42.1784 

14 

42.1464 

42.0122 

42.1067 

15 

42.1094 

42.0006 

42.0487 
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The  lowest  value  obtained  for  the  objective  function  is  41.9593 

which  was  achieved  in  the  104th  iteration  of  the  all-at-once  algorithm 

with  line  search.  After  this  iteration  the  maximum  utilization,  i.e. 
fU 

max  -  (see  Chapter  4),  was  approximately  0. 82 .  The  last  improper 

(i,i£)€JC  Ci£ 

link  was  eliminated  in  iteration  7  of  the  all-at-once  with  line  search  and 
iteration  15  of  the  one-at-a-time . 

11-node  network:  The  computational  results  for  the  network  in  Figure  4 

are  shown  in  Table  2.  The  inputs  in  this  case  are  r.(8)*5,  r,  (8)  =  r„(8) 

b  1  l 

-  r^(8)  *  r,_(8)  =  2,  r^(ll)  =  2,  and  r^(j)  =  0  for  all  other  (i,j).  This 
somewhat  contrived  example  was  designed  to  show  an  essential  difference 
between  the  all-at-once  algorithms  and  the  one-at-a-time  with  line  search 
algorithm.  The  objective  function  value  at  the  optimum  was  calculated 
to  be  37.1542  with  six  significant  digits.  At  this  value  the  maximum 
utilization  is  approximately  0.75.  From  Table  2  we  see  that  the  one-at- 
a-time  with  line  search  algorithm  converges  in  six  iterations.  The  all- 
at-once  with  line  search  converges  very  slowly;  in  fact,  it  steadily 
decreased  for  one  thousand  iterations  to  37.4961.  And  the  all-at-once 
without  line  search  actually  oscillates  and  never  converges.  This  unusual 
behavior  is  due  to  the  fact  that  the  two  destinations  (nodes  8  and  11) 
require  different  stepsizes  for  their  respective  iterations.  The  algorithm 
without  line  search  consistently  compromises,  using  a  stepsize  that  is 
too  large  for  the  destination  8  iteration  and  too  small  for  the  destination 
11  iteration.  The  all-at-once  with  line  search  merely  chooses  the  best 
possible  of  the  aforementioned  compromises,  and  since  the  basic  algorithm 
always  provides  a  direction  of  descent  (see  Chapter  2),  this  version  of 
of  the  algorithm  will  always  lead  to  a  decrease  of  the  objective  function. 


Table  2.  11-node  Network 


Iteration 

w/o  l.s. 

l.s.  a-a-o 

l.s.  o-a-a-t 

0 

340.992 

340.992 

340.992 

1 

55.1392 

49.1647 

55 .1392 

2 

44.3970 

41.1710 

37.9472 

3 

46.3674 

40.6925 

37.3075 

4 

43.4833 

40.6341 

37.2C43 

5 

45.7913 

40.5629 

37.1543 

6 

42.6035 

40.5021 

37.1542 

7 

44.9916 

40.4442 

37.1542 

8 

40.3921 

9 

40,3421 

10 

40.2960 

11 

40.2517 

12 

40.2102 

13 

40.1702 

14 

40.1325 

15 

40.0960 

_ 
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but,  as  we  see,  convergence  may  come  very  slowly.  Of  course,  none  of 
this  causes  any  problem  for  the  one-at-a-time  with  line  search  algorithm 
which  simply  chooses  the  appropriate  stepsize  for  each  destination  and 
since  there  is  little  interaction  between  the  flow  destined  for  node  8 
and  that  for  node  11,  the  convergence  is  rapid. 

16-node  network:  For  the  network  in  Figure  5  the  computational  results  are 
given  in  Table  3  for  the  inputs  r  (j)  =  3  for  all  i=l,...,16  and 
j=[(i+3)(mod  16)]+1  or  j  =  [  (i+11)  (mod  16)  ]+l  and  r  ( j  )  =  0  for  all  other 
(i,j).  The  smallest  value  obtained  for  the  objective  function  is  69.1432. 
This  was  achieved  after  55  iterations  of  the  one-at-a-time  line  search 
algorithm  by  a  routing  with  maximum  utilization  of  about  0.76.  The  last 
improper  links  were  removed  in  iteration  15  for  the  all-at-once  with  line 
search  and  in  iteration  18  for  the  one-at-a-time. 

^°,  the  initial  point  used  here  happened  to  be  an  inflection 
point,  which  accounts  for  the  constancy  of  the  value  of  the  first  iteration. 
This  unusual  situation  did  not  come  unpredicted,  see  [2],  pp.  76-77. 

26-node  network:  This  network,  shown  in  Figure  6  with  results  in  Table  4 
had  inputs  r^(j)  *  5.5  for  i  =  l,...,26,  j=[(i+6)(mod  26)]+lor 
j*  [  (i+19)  mod  26]+l,  and  r^(j)  =  0  for  all  other  (i,j).  The  lowest  value 
achieved  is  65.3304  after  40  iterations  of  the  all-at-once  line  search 
algorithm  where  the  maximum  utilization  was  found  to  be  about  0.75.  The 
last  improper  link  appeared  in  the  15th  iteration  of  both  algorithms. 

32-node  network:  This  network  with  results  in  Table  5  is  shown  in  Figure  7. 
The  inputs  were  r^(j)  =  12  for  all  1*1,...,  32  and  j=[(i+7)(mod  32)  ]+l 
or  j  *  [(i+23)(mod  32)]+l,  and  r^(j) =  0  for  all  other  (i,j).  The  smallest 


/ 


Figure  5.  16-node  network. 
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Table  3.  16-node  Network 


Iteration 

w/o  l.s. 

l.s.  a-a-o 

l.s.  o-a-a-t 

0 

2415.93 

2415.93 

2415.93 

1 

2415.93 

2415.93 

2415.93 

| 

2 

241.869 

197.516 

89.6904 

3 

99.5542 

95.5172 

73.1810 

4 

70.9437 

69.7513 

71.3961 

5 

70.5455 

69.5667 

70.6898 

6 

69.9786 

69.4649 

70.1559 

7 

69.7682 

69.3996 

69.7715 

8 

69.4698 

69.3600 

69.5746 

9 

69.3885 

69.3332 

69.4441 

10 

69.2789 

69.3050 

69.3668 

11 

69.2503 

69.2745 

69.3116 

12 

69.2256 

69.2453 

69.2631 

13 

69.1959 

69.2276 

69.2143 

14 

69.1620 

69.2082 

69.1922 

15 

69.1492 

69.1890 

69.1721 

32 


Figure  6.  26-node  network  (all  capacities  =  50). 
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Table  4.  26-node  Network 


Iteration 

w/o  1 . s  . 

l.s.  a-a-o 

l.s.  o-a-a-t 

0 

3840.44 

3840.44 

3840.44 

, 

1 

92.1412 

76.0794 

74.3970 

2 

79.2213 

70.0616 

68.2911 

3 

73.4412 

67.576o 

67.0121  | 

4 

68.7712 

66.9592 

66.4396 

5 

67.9364 

66.5555 

66.2142 

6 

67.2223 

66.2944 

66.1112 

7 

66.7473 

66.2457 

66.0541 

8 

66.4142 

66.0359 

65.9321 

9 

66.0317 

65.9549 

65.8197 

10 

65.9131 

65.8992 

65.7648 

11 

65.8552 

65.7897 

65.6613 

12 

65.7893 

65.6702 

65.5172 

13 

65.6795 

65.6300 

65.5551 

14 

65.5545 

65.5444 

65 . 4544 

15 

65.4632 

65.4743 

65.3912 

Figure  7.  32-node  network  (all  unlabeled  nodes  have  capacity  30). 


Iteration 


0 


v/o  l.s, 


s.  a-a- 


4827.75 

j  4827.75 

4827.75 

654.959 

1  566.323 

j 

654.959 

219.781 

!  183.398 

1 

!  118.723 

i 

107.855 

105.179 

| 

102.377 

104.116 

!  100.514 

1  98.4962 

98.5500 

j  98.9765 

96.6925 

97.2813 

1  98.3628 

95.7593 

96.8288 

97.1440 

95.2549 

96.2908 

96.8543 

94.9314 

95.7999 

96.3476 

94.8542 

95.4387 

95.9965 

94.8240 

94.9667 

95.5426 

94.8008 

94.8650 

95.2509 

94.7918 

94.8212 

95.0177 

94.7843 

94.8021 

94.8764 

94.7791 

94.8168 

94.8309 

94.7762 
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value  obtained  was  94.7658,  which  was  achieved  after  39  iterations  of  the 
all-at-once  line  search  algorithm.  At  this  point  the  maximum  utilization 
was  0.61.  xhe  last  improper  links  were  found  in  iteration  7  of  the  one- 
at-a-time  line  search  algorithm  and  iteration  15  of  the  all-at-once  line 
search  algorithm. 

61-node  network:  This  network,  shown  in  Figure  8,  has  the  ARPANET 
topology  as  of  August  1978.  The  results  are  given  in  Table  6  and  the  input 
are  r.(j)  =  3.75  for  i  *  1, ...  ,61  and  j  =  [  (i+14)  (mod  61 )  ] -4-1  or 
j=  [(i+45)(mod  61)]+1,  and  r  ( j )  =  0  otherwise.  15  iterations  of  the  one-at 
a-time  algorithm  and  73  iterations  of  the  all-at-once  line  search  algorithm 
were  performed,  in  neither  case  were  all  improper  links  eliminated.  The 
smallest  objective  function  value  was  obtained  in  the  all-at-once  line 
search  algorithm  at  149.782  and  the  corresponding  maximum  utilization  was 
about  0.87. 

10-  and  50-node  networks:  These  networks,  shown  in  Figures  9  and  10, 
respectively,  are  included  to  illustrate  a  point  discussed  in  Chapter  4. 

The  computational  results  are  contained  in  Table  7  for  both  networks. 

The  10-node  network  has  inputs  r^CD  =  r^(l)  *  20  and  r^(j)  =  0  for  all  other 
(i,j).  The  50-node  network  has  inputs  r^Cl)  =  r^(l)  =  20  and  r^ (j )  =  0 
for  all  other  (i,j). 
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dH§) 


Figure  G.  61-node  network  (ARPANET  topology  as  of  9/7G) (all  capacities  =50). 
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Table  6.  61-node  Network 


Iteration 


w/o  l.s. 


l.s.  a-a-o 


l.s.  o-a-a 


15,041.5 

163.992 

153.692 

152.620 

152.176 

151.819 

151.564 

151.312 

151.081 

150.886 

150.737 

150.609 

150.491 

150.397 

150.323 

150.258 


15,041.5 

168.815 

162.528 

155.811 

155.212 

154.544 

154.371 

154.053 

153.958 

153.697 

153.672 

153.467 

153.408 

153.273 

153.203 

153.105 


15,041.5 
163.992 
153.574 
152.374 
151.938 
151.571 
151.232 
150.944 
150. 751 
150.576 
150.421 
150.291 
150.198 
150.089 
150.018 
149.956 


Table  7.  10-  and  50-node  Networks  (all-at-once  line  search 

algorithm  only) 


Iteration 

10-node 

network 

50-node 

network 

0 

303.484 

323.484 

1 

70.2143 

90.2536 

2 

12.0000 

51.9999 

3 

10.2502 

34.5370 

4 

10.2500 

_ 

34.3612 

i>p  ■ 
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CHAPTER  4 

MAXIMUM  LINK  UTILIZATION  AS  A  MEASURE  OF  DELAY 


4.1.  The  Algorithm 


Consider  the  following  multicommodity  flow  problem  [16] 

r  N 


(a)  minimize  max 


I  fik(J> 


^(i,k)£C[_  Cik 


subject  to 


(b) 


k£0(i) 


fik(J>- 


nj£I(i) 


fmi(j)  “  r.(j) 


Vij^j  ,  i€~,  j€‘ 


(c)  fik(j)>°  V(i>k)€j!:*  j£rt 

(d)  f  (j)  -  0  V(j,k)6C 

(e)  ^ifik(j)<c.k  V(i,k)ec. 

Let  f  denote  the  set  of  flow  variables  { f  ^(j )  |  (i  ,k)QC  ,  jGn}  and  let 


(31) 


X  =  { f I f  satisfies  (lb)-(ld)} 


and 


n 


fik  =  J£i£ik(J>* 


V(i,k)6C. 


Note  that  if  there  is  a  set  of  flow  variables  f€X  satisfying  the 
constraint  (31) (e)  then  this  f  has  objective  function  value  less  than  or 
equal  to  one.  Therefore,  if  f*  solves  problem  (31)  reformulated  without 
the  constraint  (31) (e)  then  it,  too,  has  function  value  less  than  or  equal 
to  one  and  satisfies  the  constraint  (31) (e) .  Thus  (31) (e)  is  superfluous 
We  may  now  write  (31)  more  succinctly  as 

f. 


minimize 


max 


‘ik 


(i,k)e£  ''ik 


(32) 


subject  to  f£X. 
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The  problem  (32)  may  be  solved  using  an  approximation  algorithm 
developed  by  Bertsekas  [12J  and  based  on  a  method  of  multipliers  due  to 
Kort  and  Bertsekas  [13].  In  this  procedure  we  utilize  the  algorithm  of 
Chapter  2  to  minimize  a  sequence  of  functions  which  are  better  behaved  and 
which  successively  approximate  the  objective  function  in  (32) 

Consider  the  following  problem  which  is  equivalent  to  (32) 

rf-.K.  | 

U.-J  r 

(33) 


/ 


minimize  -i  max 
<(i,k)€£ 


Icik-Uikl 


subject  to 


f£X,  u.^^O  (i,k)€£. 


Using  a  multiplier  method  with  exponential  penalty  function  (“Ov [exp(Mu)-l] 
to  eliminate  the  constraints  ^  0  (see  Kort  and  Bertsekas  [13],  Bertsekas 


[12]),  the  following  approximation  function  is  obtained 

p[f,u  ,yn]  =  ~  log{  i  yikexPtunfik/cik]} 

n  Un  (i,k)€£  lk  n  lk  lk 


(34) 


i 


where  {p^}  is  an  increasing  sequence  of  penalty  parameters  and  the  y  are  the 


multipliers  updated  via 


yiklexpfp— ^ 


n-lik  '  ik 


'ik 


(35) 


where  fn  * =  { f*\ ^(j) | (i,k)SC ,  jSfJ  minimizes  p[f,p  ,yn  over  all  f€X  and 

IK 

y°  is  chosen  such  that  y°  >0,  V(i,k)£C  and  E  y°  *  1.  (In  the  sub- 

\  (i,k)€C  lk 

sequent  examples  let  y^k = —  V(i,k)£C.) 

The  algorithm  proceeds  as  follows: 

Iteration  0:  Having  chosen  UQ  and  y°,  minimize  p[f,uo,y°]  over  X  to  find  f°. 

(Note  that  since  —  log(’)  is  an  increasing  function  we  may  find  f°  by 
wo 

minimizing  Z  y°  exp[y  f  /C  ].) 

(i,k)€£  lk  °  lk  lk 
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Iteration  n:  Choose  u  ,  and  compute  v11  from  u  .  ,  v11  ^ ,  and  fn  ^  bv 
-  n  '  n-1 

Determine  fn  by  minimizing  p[f,y  .v11]  over  X. 

'  n  ' 


Convergence  results  for  this  algorithm  may  be  found  in  [12],  [13]. 


4.2.  Computational  Results 

The  "all-at-once"  program  with  line  search  described  in 
Section  2.3,  was  implemented  with  D  *  y  exp [ y  f  /C  ]  for  each  (i,i)G£ 

IX  11  11  11 

where  y  and  y  were  treated  as  constants.  The  procedure  is  terminated  when 
the  following  condition  is  satisfied 

(^A)ec DUUUn  U  UJ  u 


where  e >  0  is  chosen  experimentally.  (*’e  found  e=.01  satisfactory.)  The 
multipliers  yik  and  the  penalty  parameter  are,  then,  updated  as  per 
Section  4.1:  the  y^'s  via  (35)  and  y  via  y  =  2^^  Finally,  the  procedure 
is  restarted  using  the  final  <?'s  of  the  previous  overall  iteration  as  the 
initial  p's  for  this  overall  iteration.  This  is  repeated,  usually  until  y^ 
becomes  too  large  to  exponentiate.  An  alternative  technique  could  have  been 
implemented  to  deal  with  this  situation,  however  in  most  cases  results  were 
satisfactory  by  the  time  this  problem  occurred. 


The  computational  results  using  this  algorithm  on  the  networks  of 
Chapter  3  are  given  in  Tables  8-14.  The  topologies  and  inputs  are  given 
in  Chapter  3.  The  11-node  network  is  the  only  one  not  tabulated  here  since 


the  network  was  designed  to  exhibit  a  peculiarity  of  the  algorithms  of 
Chapter  3  and  had  rather  uninteresting  results  for  the  algorithm  of  this 
chapter. 


5 


4 


Table  8.  8-node  Network 


Iteration 

V 

objective 

function 

value 

dual 

function 

value 

#  of 

subiterations 

1 

1 

.839651 

.571731 

3 

2 

2 

.835646 

.631242 

2 

3 

4 

.821258 

.713947 

1 

4 

8 

.804470 

.782249 

2 

5 

16 

.800429 

.799000 

2 

6 

32 

.800173 

.799993 

2 

7 

64 

.800289 

.800003 

1 

total 

13 

1 


Iteration 


V 


objective 

function 

value 


function 

value 


if  of 

subiterations 


1 

1 

.811112 

2 

2 

2 

.618275 

3 

3 

4 

.548648 

2 

4 

8 

.537304 

2 

5 

16 

.536741 

3 

6 

32 

.535678 

2 

7 

64 

.535338 

3 

8 

128 

.534271 

3 

I 


tota] 
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Table  12.  61-node  Metwork 


— 

Iteration 

objective 

function 

value 

dual 

function 

value 

! 

#  of 

subiterations 

1 

1 

1.07951 

.403508 

>  ! 

2 

2 

.941108 

.478478 

3 

3 

f 

4 

.915899 

.624600 

2 

1  4 

8 

.879828 

.792732 

4 

I  5 

16 

.866770 

.852357 

1  6 

32 

.867209 

.863138 

19 

_ ! _ i 

64 

.867782 

.862657 

5 

total 

38 
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We  note  thae  while  the  dual  function  value  will  always  increase, 
there  is  no  guarantee  that  the  objective  function  will  always  decrease. 

In  fact  in  the  8-,  16- ,  and  61-node  networks  there  is  a  slight  increase  in 
the  last  few  iterations.  Of  course,  we  still  can  be  sure  that  che  true 
optimal  objective  function  value  is  between  the  smallest  objective  function 
value  achieved  and  the  last  dual  function  value. 
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CHAPTER  5 
CONCLUSIONS 

The  examples  of  the  two  preceding  chapters  are,  we  feel, 
representative  of  our  overall  computational  experience.  All  of  the  networks 
considered,  and  a  number  of  others,  were  run  with  a  variety  of  inputs  and 
the  results  were  generally  similar.  Two  of  the  networks  exhibited  (the  26- 
and  61-node  networks)  came  from  early  versions  of  the  ARPANET.  The  others 
were  designed  with  certain  emphasized  characteristics.  For  example,  the 
16-node  network  (see  Figure  5)  symbolizes  two  presumably  distant  centers, 
with  "local"  traffic,  connected  by  a  small  number  of  higher  capacity 
links  (e.g.  the  East  and  West  Coasts  of  the  U.S.A,  Europe  and  the  U.S.A.). 

The  line  search  procedure  used  here  is  complex  and  consumes  more 
computer  time  than  seems  affordable  by  its  success.  The  examples  of 
Chapter  3  give  little  evidence  of  any  significant  improvement  due  to  use  of 
this  line  search.  The  excessive  cost  is  particularly  evident  in  the  one-at- 
a-time  where  the  line  search  must  be  performed  N  times.  It  is  possible  that 
some  ad  hoc  line  search  might  be  used  in  extreme  cases  (e.g.  when  the 
objective  function  value  is  not  decreased  by  some  percentage) . 

One  problem  our  particular  line  search  was  designed  to  alleviate 
is  the  persistence  of  improper  links.  This  it  did  quite  well,  although 
with  less  ease  when  the  utilization  was  high  for  several  links.  However, 
the  existence  of  improper  links  in  the  algorithm  without  line  search  seemed 
to  be  no  impediment  to  convergence. 

In  the  algorithm  of  Chapter  4  convergence  was  relatively  swift 
even  when  the  network  was  unusually  congested  (the  ARPANET  is  known  to  rarely 
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run  with  average  link  utilization  over  50%). 

Since  the  two  measures  of  delay  discussed  here  are  intrinsically 
different  a  choice  of  one  over  the  other  would  most  likely  depend  on  the 
properties  of  the  network  under  consideration.  On  the  other  hand,  given 
that  one  had  performed  the  optimization  for  one  measure  of  delay,  one  might 
like  to  know  whether  largely  different  results  would  have  been  obtained  had 
one  used  the  other  criterion.  Table  15  contains  the  maximum  utilization 
and  Kleinrock  delay  for  flows  near  the  optimum  in  the  algorithms  of  Chapters 
and  4.  With  the  exception  of  the  50-node  network  the  figures  are  quite  close 
However,  the  50-node  network  is  indicative  of  a  situation  which  can  be 
pushed  to  the  extreme. 

Consider  a  network  with  N  nodes  (where  for  simplicity  N  is  assumed 

to  be  even)  arranged  in  an  oblong  fashion  with  each  node  linked  to  the  next 

(as  in  the  50-node  network)  so  that  the  links  form  an  elongated  ellipse. 

Also  let  the  end  nodes  be  1  and  N,  and  let  one  of  the  two  nodes  linked  to  1 

be  3.  Let  the  capacity  for  each  link  be  30  and  let  r3(l) *  rN(l)  =  30  and 

r^(j)  =  0  for  all  other  (i,j).  It  is  easily  seen  that  the  optimal  flow  for 
the  maximum  utilization  case  Is  to  send  all  flow  from  3  directly  to  1  and 
all  the  flow  from  N  to  1  so  that  it  does  not  pass  through  3  thereby  achieving 
the  minimum  of  2/3  maximum  link  utilization  regardless  of  how  large  N  is. 

On  the  other  hand,  it  is  a  messy  but  straightforward  calculation  to  show  that 
as  N ->■ 00  the  minimum  Kleinrock  delay  becomes  infinite. 

The  Kleinrock  delay  function  for  an  individual  link  may  be  written 
as  ]^'(f/c)  •  If  the  sum  of  such  delays  is  bounded  in  a  collection  of  network 
routings  then  the  corresponding  maximum  utilization  is  similarly  bounded 
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Table  15.  A  comparison  of  the  two  delays  near  their  respective 
optima 


Netwo rk 

Maximum  Utilization 

Kle.inrock  Delay 

Chapter  3 
Algorithm 

Chapter  4 
Algorithm 

Chapter  3 
Algorithm 

Chapter  4 
A1  gorithm 

8-node 

.821 

.800 

41.9 

42.0 

10-node 

.777 

.667 

10.3 

12.0 

16-node 

.761 

.750 

69.1 

70.3 

26-node 

.753 

.734 

65.3 

66.7 

32-node 

.615 

.534 

94.8 

95.3 

50-node 

.862 

.667 

34.4 

52.0 

61-node 

.870 

.864 

149.8 

153.9 
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